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In classical and quantum information theory, operational quantities such as the amount of ran- 
domness that can be extracted from a given source or the amount of space needed to store given 
data are normally characterized by one of two entropy measures, called smooth min-entropy and 
smooth max-entropy, respectively. While both entropies are equal to the von Neumann entropy in 
certain special cases (e.g., asymptotically, for many independent repetitions of the given data), their 
values can differ arbitrarily in the general case. 

In this work, a recently discovered duality relation between (non-smooth) min- and max-entropies 
is extended to the smooth case. More precisely, it is shown that the smooth min-entropy of a system 
A conditioned on a system B equals the negative of the smooth max-entropy of A conditioned on 
a purifying system C. This result immediately implies that certain operational quantities (such as 
the amount of compression and the amount of randomness that can be extracted from given data) 
are related. Such relations may, for example, have applications in cryptographic security proofs. 



I. INTRODUCTION 

Entropies are used to quantitatively characterize prob- 
lems in quantum information processing and quantum 
cryptography. In the case of many independent and iden- 
tical instances of a task (i.i.d. limit), the von Neumann 
entropy is the relevant measure. In order to go beyond 
this restriction, the smooth min- and max-entropies have 
been introduced. The smooth min-entropy was intro- 
duced in order to characterize randomness extraction. It 
corresponds to the length of uniform random string that 
can be generated from a partially unifrom one P, Q • The 
smooth max-entropy, on the other hand, was introduced 
to characterize information reconciliation. It gives the 
amount of communication required between two parties 
in order that they can generate a perfectly correlated 
string from a partially correlated one [|[ . Since their ini- 
tial uses, these entropies have found applications in many 
tasks (see for example (HHf) and have been shown to con- 
verge to the von Neumann entropy in the i.i.d. limit @,@]- 

The smooth entropies can be defined as optimiza- 
tions of the relevant non-smooth quantities — the (non- 
smooth) min- and max-entropies — over a set of nearby 
states. 'Nearby' is specified via a smoothing parameter, 
the maximum distance from the original state in an ap- 
propriate metric (for precise definitions, see below). Of- 
ten, the smooth entropy is the correct measure when one 
accounts for a small error tolerance, whereas the non- 
smooth entropy characterizes the zero error case. In the 
case of privacy amplification, for example, ideally one 
wants a protocol in which two parties, Alice (A) and 
Bob (B), use a shared string about which an eavesdrop- 
per (E) has partial information and form a secret key 



about which E knows nothing. Unfortunately, such a 
stringent requirement is usually unattainable. Instead, 
one tolerates a small probability that the eavesdropper 
learns something about the key in order to achieve a sig- 
nificant key length. In this case, the smooth min-entropy 
of A given E characterizes the length of the key, with 
the smoothing parameter dependent on the tolerable er- 
ror 

It has recently been discovered that the min- and max- 
entropies are related @- They are dual to one another 
in the sense that for a pure state p A Bc on a tri-partite 
Hilbert space 7Ya <8> Hb <S> T~tc j the conditional min-entropy 
of A given B is the negative of the conditional max- 
entropy of A given C, i.e. H min (A\B) p = -H max (A\C) p . 
In this work, we extend the duality relation to the smooth 
min- and max-entropies. In order to do this, a new 
method of smoothing is required: We propose measur- 
ing the closeness of states used in the definition of the 
smooth entropies in terms of a quantity which we call 
the purified distance. This forms a metric on the set 
of sub- normalized states (positive semi-definite operators 
with trace at most 1). When defined in this way, the 
smooth min- and max-entropies satisfy various natural 
properties such as invariance under local isometries and 
the data processing inequality (that quantum operations 
cannot decrease entropy) . The duality not only simplifies 
many derivations 1 , but it provides a connection between 
seemingly unrelated problems. In particular, this means 
that randomness extraction and information reconcilia- 
tion can be characterized by the same entropy. 

In the context of quantum key distribution, the new re- 
lation has the following application. In order to generate 
a secure key, Alice and Bob need to bound the smooth 
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1 Various relations for the min-entropy hold automatically for the 
max-entropy via the duality, e.g. the fact that conditioning on 
an additional system always reduces entropy (cf. Theorem [TSjl . 
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min-entropy of A conditioned on E. Our result provides 
a way for them to generate this bound without access to 
the eavesdropper's systems. In the worst case, the eaves- 
dropper holds a purification of the state of A and B. (The 
data processing inequality (Theorem 1 1 8j> implies that if 
she does not, her information about the key is strictly 
smaller.) Using the duality relation, Alice and Bob ob- 
tain the desired bound on the smooth min-entropy by 
estimating the smooth max-entropy of A given B. 

There is an alternative method for going beyond i.i.d. 
in information theory, known as the information spec- 
trum method [1, [^, [l(| • Like for smooth entropies, there 
are two principal quantities: the inf-spectral entropy rate 
which is related to the smooth min-entropy and the sup- 
spectral entropy rate which is related to the smooth max- 
entropy . The results of this paper imply that a sim- 
ilar duality relation holds for the spectral entropy rates. 

The remainder of this paper is organized as follows. In 
Section |TT] we introduce the purified distance and prove 
that it is a metric on sub-normalized states. In Section|TTT] 
we use this metric to define a ball of states around a par- 
ticular state. This ball is then used to define the smooth 
conditional min- and max-entropies in Section IIVI and 
to prove that they satisfy data processing inequalities in 
Section [V] 

II. METRICS ON THE SET OF 
SUB-NORMALIZED STATES 

Let Ti be a finite-dimensional Hilbert space. We use 
C(Ti) and V(Ti) to denote the set of linear operators on 
Ti and the set of positive semi-definite operators on Ti, 
respectively. We define the set of normalized quantum 
states by S = (H) := {p G V(Ti) : tr p — 1} and the set 
of sub-normalized states by S<(Ti) :— {p G V(TC) : < 
trp < 1}. Note that C{H) D V{H) D S<(TC) D S=(H). 
Given a pure state \<p) G Ti, we use (f> = \(f>)((j)\ to denote 
the corresponding projector in V(Ti). 

We start by introducing a generalization of the trace 
distance: 

Definition 1. For p, r G V(TL), we define the generalized 
trace distance between p and r as 

D(p,r) := max{tr{p- t}+, tr{r- p}+} , 

where {A} + denotes the projection of A onto its positive 
eigenspace. 

In the case of normalized states, we have tr {p — r} + = 
tr {t— p} + and recover the usual trace distance D(p, t) :— 
tr {p — t} + . The generalized trace distance can alter- 
natively be expressed in terms of the Schatten 1-norm 
||A||i = tr|A| = trVX^X as 

-, , 1 N I, 1 1 i 
D(P,t) = -|| / o-T|| 1 + -|tr/3-trr| 

and it is easy to verify that it is a metric on C(Ti). The 
trace distance has a physical interpretation as the distin- 
guishing advantage between two normalized states. In 



other words, the probability pdist (p, t) of correctly guess- 
ing which of two equiprobable states p and r is provided 
is upper bounded by [12| 

Pdis t(p,T)<^(l + D( P ,T)). (1) 

Various quantities derived from the fidelity F(p, r) = 
|| -v/Pa/^II i are used in the literature to quantify the 
distance between normalized states. Its generaliza- 
tion to sub-normalized states satisfies < F(p, t) < 
y / trp VtrT and is monotonically increasing under trace 
preserving completely positive maps (TP-CPMs), i.e. 
F(S(p),£{t)) > F(p,r) for any TP-CPM £ (cf. [13], 
Theorem 9.6). Moreover, we will often use Uhlmann's 
theorem [l3j which states that, for any purification (p of 
p, there exists a purification t9 of r such that F(p, r) = 
Ffajfl) = \(ip\d)\. The fidelity is also symmetric in its 
arguments, i.e. F{p,r) = F(r,p). 

For our argument, we need an alternative generaliza- 
tion of the fidelity to sub-normalized states. The gen- 
eralization is motivated by the observation that sub- 
normalized states can be thought of as normalized states 
on a larger space projected onto a subspace. We write 
Ti 5 Ti if a Hilbert space Ti is embedded in another 
Hilbert space Ti and denote the projector onto Ti by n. 

Definition 2. For p,r G S<(Ti), we define the general- 
ized fidelity between p and r as 

F( P ,t) := sup sup F(p,f). (2) 

TiDH p,feS = (H) 

p=npn, r=nf n 

Note that F reduces to F when at least one state is 
normalized. This can be seen from the following alterna- 
tive expression for F: 

Lemma 3. Let p,r G S<(Ti). Then, 

F(p, t) = F{p, t) = F(p, t) + V(l-trp)(l-trr) , 

where p :— p<3) (1 — trp) and f :— r © (1 — trr). 

Proof. Let Ti, p and f be any combination of Hilbert 
space and states that are candidates for the maximiza- 
tion in ©. Let £ : Ti — > H be the pinching £ : p i-^ 
HpH + n^/?n^, where n is the projector onto Ti and 
= 1-h — n its orthogonal complement. Hence, 

F(p,?)<F(£(p),£(f)) 

= F{ P , t) + F(n ± pii ± , n ± f n x ) 

< F( P ,t) + v/(l-trp)(l-trr). 

It is easy to verify that the upper bound is achieved by 
Ti = Ti © C, p and f . □ 

We define a metric based on the fidelity, analogously 
to the one proposed in [T^. [l5j 2 : 



2 The quantity C(p,r) = y/T— F 2 (p, r) is introduced in [13 . 
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Definition 4. For p, t G 5<(7i), we define the purified 
distance between p and r as 

P(p,r) := y/l-F(p,r)* 

The name is motivated by the fact that, for normalized 
states p, r G 5 = (W) , we can write P(p, r) as the minimum 
trace distance between purifications \<p) of p and of r. 
More precisely, using Uhlmann's theorem [13j, we have 

P(p, r) = sJl-F{ Pl T) 2 = /l-max|(^}| 2 



= miW i - | (^tf) | 2 = mm . 

Lemma 5. The purified distance P is a metric on 
S<{H). 

Proof. Let p, r and er be any states in 5<(7i). The con- 
dition P(p, t) = <^=^ p = t can be verified by inspec- 
tion, and symmetry P(p, r) = P(t, p) follows from the 
symmetry of the fidelity. 

It remains to show the triangle inequality P(p, r) < 
P(p,a) + P(<t, t). Using Lemma [31 the generalized fi- 
delities between p, r and tr can be expressed as fideli- 
ties between the corresponding extensions p, f and a. 
Furthermore, we use Uhlmann's theorem to introduce 
purifications \r) of p, \s) of a and \t) of f such that 
F(p,a) = \{r\s)\, F(a,r) = \{s\t}\ and F(p,r) > \{r\t)\. 
Hence, 

P(p,a) + P{a,T) = P(r,s) + P(s,t) 
= D(r,s) + D(s,t) 
>D{r,t)=P{r,t)>P{p,T), 

where we have used the triangle inequality for the trace 
distance. □ 

The following lemma gives lower and upper bounds to 
the purified distance in terms of the generalized trace 
distance. 

Lemma 6. Let p, r G S< (Ti ) . Then 

D( P ,t)<P(p,t) < ^2D{p,r). 

Proof. We express the quantities using the normalized 
extensions p and f of Lemma [3] to get 

P(p, r) = VT- F(p, t) 2 > D(p, t) = D(p, t) and 
P(p, t) 2 = 1 - F(p, f f < I - (1 - D(p, t )) 2 < 2D(p, t) , 

where we have made use of I — F(p,f) < D(p,r) < 
i/l - F(p,r) 2 (see e.g. 0, Section 9.2.3). □ 



where they also show that it is a metric on <S=('H). In fTBI) the 
quantity is called sine distance and some of its properties are 
explored. 



A useful property of the purified distance is that it does 
not increase under simultaneous application of a quan- 
tum operation on both states. We consider the class of 
trace non-increasing CPMs, which includes projections. 

Lemma 7. Let p, r G S<{Ti) and £ be a trace non- 
increasing CPM. Then, P(p,r) > P(£ (p), E (r)) . 

Proof. Note that a trace non-increasing CPM £ : 
V(Tt) — > V(H') can be decomposed into an isometry U : 
® Ti" followed by a projection II £ V{H' ® H") 
and a partial trace over H" (see, e.g. |12j . Section 8.2). 
The isometry and the partial trace are TP-CPMs and, 
hence, it suffices to show that F(p,r) < F(£(p),£(t)^ 
for TP-CPMs and projections. 

First, let £ be trace preserving. Using Lemma [3] and 
the monotonicity under TP-CPMs of the fidelity, we see 
that 

F(p, t) = F(p, t) + V(l-trp)(l-trr) 

< F(£(p),£(r)) + v /(l-trp)(l-trr) 
= F(£(p),£(r)). 

Next, consider a projection II G V(H) and the CPM 
£ : p 1— > rtpll. Following Definition [21 we write F(p,r) — 
sup F(p,f), where the supremum is taken over all ex- 
tensions {H, p, f} of {7i,p, t}. Since all extensions of 
{Ti,p, t} are also extensions of {supp {IT}, ilpIT, nrlT} , 
we find F(n P U, UtU) > F(p, r). □ 

The main advantage of the purified distance over the 
trace distance is that we can always find extensions and 
purifications without increasing the distance. 

Lemma 8. Let p,r G S<(H), W = H and ip G H (8> W 
be a purification of p. Then, there exists a purification 
'd£H®H'ofTwithP{p,T)=P(p,d). 

Proof. We use Uhlmann's theorem to choose ■& G H ® 
W such that F{p,r) = F((p,&) and, thus, P(p,r) = 
P{p,d). □ 

Corollary 9. Let p,r G S< (H) and p G S<(H ® H') 
6e an extension of p. Then, there exists an extension 
T eS<{H®H') ofr with P(p, t) = P(p, f) . 

Proof. Let W" = Tt®Tt' be an auxiliary Hilbert space and 
ip G 7i ®W' (8 H" be a purification of p. We introduce 
a purification $ G H ® TL 1 ® H" of t with P^,??) = 
P(p, r) using Lemma [5] and f = tr H » 1?. However, due to 
Lemma [3 we have P(p,d) > P(p, f) > P(p, t), which 
implies that all three distances must be equal. □ 

III. THE e-NEIGHBORHOOD INDUCED BY P 

The e-smooth min-entropy of a state p is usually de- 
fined as a maximization of the min-entropy over a set 
of states that are £-close to p. Various definitions of 
such sets — subsequently called e-balls — have appeared 
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in the literature. None of the existhing definitions ex- 
hibit the following two properties that are of particular 
importance in the context of smooth conditional min- 
and max-entropies: Firstly, the smooth entropies should 
be independent of the Hilbert spaces used to represent 
the state. In particular, embedding the density opera- 
tor into a larger Hilbert space should leave the smooth 
entropies unchanged. This can be achieved by allowing 
sub-normalized states in the e-balls. Secondly, it will 
be important that we can define a ball of pure states 
that contains purifications of all the states in the e-ball. 
This allows us to establish the duality relation between 
smooth min- and max-entropies and is achieved by us- 
ing a fidelity-based metric to determine e-closeness. The 
following ball possesses both of the above properties: 

Definition 10. Let e > and p £ S<(TL) with y/tr p > e. 
Then, we define an e-ball in TL around p as 

B'(H;p) :={TeS<(H) :P(r,p) < e} . 

We also define := {r e B E (TL;p) : rankr = 1}, 

i.e. an e-ball of pure states around p. 

We now prove some properties of the e-ball that will be 
important for our later discussion of smooth conditional 
min- and max-entropies. Properties i)-iv) clarify what 
we mean by an e-ball around p. Property v) ensures 
that states in the ball remain in the ball after applying 
an isometry, while Properties vi) and vii) relate to how 
the e-balls change under partial trace and purification. 
These will be particularly relevant for the duality relation 
between the smooth min- and max-entropies. 

i) The set B £ (TL; p) is compact and convex. 

Proof. The set is closed and bounded, hence compact. 
For convexity, we require that, for any A £ [0,1] and 
(7, r e B £ (TL; p), the state u := Act + (1 — A)t is also in 
B 6 (TL;p). We define cD = u> (1 — trw) and analogously 
p, a and f. By assumption we have F(ct, p) > \J\ — e 1 
and F(f,/5) > \J\ — e 2 . We use the concavity of the 
fidelity (cf. [13, Section 9.2.2) to find 

p(tu,p) = ^i-F(iu,pr 

= V /1-F(A«7 + (1-A)f, ( 5) 2 
< \/l-(\F(a,p) + (l-\)F(f,p)) 2 <e. 
Therefore, id 6 B £ (TL;p), as required. □ 

ii) Normalized states in B £ (TL; p) are not distinguish- 
able from p with probability more than |(1 + e). 

Proof. By Lemma HI t 6 B £ (TL;p) implies D(r,p) < 
P{ t tP) < e - The statement then follows from ([T]). □ 

iii) The ball grows monotonically in the smoothing pa- 
rameter e. Furthermore, B°(TL;p) = {p}. 



iv) The e-balls are symmetric and satisfy a triangle 
inequality. In other words, we have 

r eB £ (TL;p) P eB £ {TL;t) and 

t e B £ {H; P ) /\a e B 6 '(H;t) => a e B e+e ' (H; p) . 

Proof. These properties follow directly from the fact that 
P is a metric (cf. Lemma [5}. □ 

v) The e-balls are invariant under isometries. Let U : 
TL — * TL' be an isometry, then 

r € B e (TL; p) => Urrf e B e (TL';UpU^) . 

Conversely, if n is the projector onto the image of 
U, then 

a e B E (TL';UpU^) => U^IlaUU e B E (TL; p) . 

Proof. This property follows from Lemma[7]and the fact 
that p h-> UpW and p i-> WUpUU are trace non- 
increasing CPMs. 3 □ 

vi) The e-balls are monotone under partial trace. More 
precisely, let TL' be a Hilbert space and tr w . the 
partial trace over TL' , then 

t eB e {TL®TL'; P ) => tr w .r e B e {H; tr H . p) . 

Proof. This property is a direct consequence of Lemma [7] 
and the fact that the partial trace is a TP-CPM. □ 

vii) On a sufficiently large Hilbert space, there exists a 
purification of the e-ball in the following sense: Let 
TL' be a Hilbert space with dimTL' > dimTL and 
tpeTL®TL', then 

t eB £ (TL;tr H ,<p) =► 

3 d e B £ p (TL ® TL'; if) s.t. r = tr„, d . 

Proof. This property follows from Lemma [5] 4 □ 



3 Note that the state U^TicrYW is not necessarily normalized. Def- 
initions of e-balls that do not allow sub-normalized states will 
not be invariant under isometries in the sense proposed here. 
This property will be used to show that the smooth min- and 
max-entropies are invariant under local isometries in Lemmas 1 131 
and [TS] 

4 This property of the e-ball is due to our use of a fidelity-based 
metric. In particular, it does not hold for an e-ball based on 
the trace distance, such as {r £ <S<(W) : D(p,r) < e}. We will 
use this in Lemma 1171 to show that the duality relation for the 
smooth entropy holds. 
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IV. SMOOTH CONDITIONAL MIN- 
IM AX-ENTROPIES 



AND 



In this section we define smooth min- and max- 
entropies and discuss some of their properties that fol- 
low from our definition of the e-ball. In particular, the 
smooth entropies defined in the following can be seen as 
optimizations of the corresponding non-smooth entropies 
over an e-ball of states (Definition [T2l and Lemma [TB)) . 
Moreover, they are invariant under local isometries (Lem- 
mas Q2] and IT5]) and satisfy a duality relation (Defini- 
tion ED. 5 

In the following, we assume that e is much smaller 
than the trace of all involved states as is predominantly 
the case in applications. Indices are used to denote multi- 
partite Hilbert spaces, e.g. TL AB = H A ®H B and to denote 
the different marginal states of multi-partite systems. We 
often do not mention explicitly when a partial trace needs 
to be taken, e.g. if p AB € S<(H AB ) is given, then p A := 
tr B Pab is also implicitly defined. 

We define the min-entropy: 

Definition 11. Let p AB G S<(H AB ), then the min- 
entropy of A conditioned on B of p AB is defined as 



ffmin(A|B), 



max sup {A€ 

<T B GS = (H B ) 



2 x t A (g>a B > p AB }. 



We now use the e-ball B £ (TL;p) to define a smoothed 
version of the min-entropy 6 : 

Definition 12. Let e > and p AB G S<(Tt AB ), then the 
e-smooth min-entropy of A conditioned on B of 
defined as 



B5un(A|B), 



max ff min (A|B)p 



Pab6B c (pab 



The quantity is monotonically increasing in e due to 
Property iii) in Section IIIII and we recover the non- 
smooth entropy by ff° in (A|B) p = ff min (A|B) p . Con- 
tinuity of the smooth min-entropy as a function of the 
state is shown in Appendix [XJ 

The smooth min-entropy is independent of the Hilbert 
spaces used to represent the density operator locally, as 
the following lemma shows: 

Lemma 13. Let e > 0. p AB G S<(H AB ) and U : TL A — > 
Ti c an d V '■ 7~Lb —> 7~Ln be two isometries with r CD := 
(U® V)p AB (W ® Vt), then 

tfmin(A|B) p = J fff nin (C|D) T . 



5 For convenience of exposition, we will define the smooth max- 
cntropy as the dual of the smooth min-entropy (Definition 1141 
and then prove that this definition is equivalent to an optimiza- 
tion over an e-ball of states of the non-smooth max-entropy 
fLemma ll6l l. 

6 Note that we drop H when the Hilbert space is clear from the 
indices of the state. 



Proof. First note that the e-smooth min-entropy 
H^ in (A|B) can be written as 



#min( A l B )p =. max , max 

PAB < 1a®<TB 



logtrcr B , (3) 



where log denotes the binary logarithm. Now, we let 
p AB € B £ (p AB ) and a B G V(H B ) be the pair of states that 
maximize this expression, i.e. H £ ain (A\B) p = — logtr cr B . 
Then p AB < 1 A ® a B implies 

(U ® V)p AB {U' { ® V 1 ) < UU*®Va B V* < 1 ® Vv B V* . 



The e-ball is invariant under isometries (cf. Property v)) 
and, therefore, the pair G B £ (t cd ) and lj d G V(H d ) 
is a candidate for the optimization in H^ lin (C\D) T . We 
bound 

H 6 min (C\B) T > - logtr u D = - logtr a B = fff nin (A|B) p . 

The argument in the reverse direction is similar. Let 
f CD G B £ (t cd ) and cD D G V(H D ) be the pair that max- 
imizes -H^jj^ClD),-. Moreover, we introduce n uv = 
IIu (g) n v , where H v and n v are the projectors onto the 
image of U and V respectively. Then f CD < l c ® w D 
implies 

(17+ ®v r )n uv f CD n uv {u ®v) <t A ® v^n v Cj D u v v . 



The pair p AB G B £ (p AB ) and a B G V(TL B ) is a candidate 
for the optimization in _ff^ in (A|B) p (cf. Property v)) and 
we get 

i^ lin (A|B) p > -logtr^B = - logtr (II v a) D ) 



>- logtr u> D = ff^(C|D) T . 
We thus conclude that iJf nin (A|B) p = H^ ln (C|D) T . 



□ 



We next define the dual of the smooth min-entropy, 
the smooth max-entropy: 

Definition 14. Let e > 0, p AB G S<(H AB ) and p ABC G 
S<(Ti. ABC ) an arbitrary purification of p AB , then the e- 
smooth max-entropy of A conditioned on B of p AB is de- 
fined as 



£^ ax (A|B) p := -^ in (A|C), 



(4) 



The quantity is well-defined since all purifications of 
p AB are equivalent up to an isometry on the purify- 
ing space H c , which docs not change H^ in (A|C) as 
Lemma Q2] shows. The non-smooth max-entropy is given 
by if max (A|B) := H^ ax (A\B). An alternative expression 
for the max-entropy was given in Q : 



# max (A|B) p 



max log F(p A 

<y B eS = (H B ) v 



.1. 



(5) 



The smooth max-entropy is independent of the Hilbert 
spaces used to represent the density operator locally: 
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Lemma 15. Let e > 0, p AB S S<(H AB ), and U : H A — > 
7i c and V : 7i B ~~ * H D &e iwo isometries with r CD := 
(l/®10pAB(l/ + ®Vt), i/ien 

#max( A l B )p = #max( C l D )r ■ 

Proof. Let /9 ABE be a purification of p AB , then t cde = 
(U ® V® l E )p ABE (f/ t ® Ft (g) 1 E ) is a purification of t cd . 
Thus, 

flSu«(A|B) p = -i^ in (A|E) p 

= -#mm( C l E )T = #max( C l D )r • 



We may now write (again using Lemma [T"7l as well as 
Definition Q3] twice each) : 

#ma X (A|B) p = - _ max H min {A\C) p 

p A c60 e (PAc) 

min -H min (A\C)p 

PAB'G ee p(PAB'c) 

> m in -^ m i„(A|C) p - 

> min H max (A\B) p , 

p AB EB € (p AB ) 



which concludes the proof. 



□ 



□ 

The e-smooth max-entropy can also be written as an 
optimization over an e-ball of states: 

Lemma 16. Let e > and Pab G S<(H AB ), then 

#max(A|B) p = min ff max (A|B)p. 

Pab€8 c (pab) 

In order to prove the above lemma, we characterize 
the e-ball in terms of an e-ball on the purified space. 
The following lemma follows directly from Properties vi) 
and vii) in Section IIIII and will be used repeatedly: 

Lemma 17. Let p G S<{TL) and <f> G S<(7i (g) W) be a 
purification of p, then 

B e (Tt; p)^{peS<(H):3 4>e B E p (H®H'; <p) s.t. p = tr H ,<^} 

and the two sets are identical if the Hilbert space dimen- 
sions satisfy dim7Y' > dim7Y. 

Proof of LemmaUM Let p ABC G S<(H ABC ) be a purifi- 
cation of p AB with dim7^ c > dim7i AB . Then, using 
Lemma [T7] as well as Definition [T?] twice each, we have 

H° max (A\B) p = - _ max iJ min (A|C), 

PACeB e (PAc) 

< . min -H min (A|C) p 

PABC60 E (PABCJ 

min H max (A\B) p . 

PABSC e (pAB) 

To show the other direction, we choose a purifica- 
tion Pabc G S<(Tl ABC ) and embed TL B into a larger 
space 7i B i such that dim7i B < > dim7i AC . We define 
Pab'c a s the embedding of p ABC into 7i AB > c - Further- 
more, for each p AB / c G B p (p AB ' C ) wc construct p AB i c = 
(1 A <g n B <g 1 c )Pab'c(1a <8> n B <g l c ), where I1 B is the 
projector onto Ti. B , such that p AB ' C remains in B p {p AB ' C ) 
and has support on H ABC - The set {II B ,1 B ' — n B } de- 
scribes a measurement on Tl B > and the post-measurement 
state p AC G S<(TC AC ) satisfies p AC < p AC . Hence, 
H min (A\C) p < H min (A\C)- p . 



V. DATA-PROCESSING INEQUALITIES 

As an example of an application of the duality between 
smooth conditional min- and max-entropies, we consider 
data-processing inequalities for the two entropies. 

We expect measures of uncertainty about the system 
A given side information B to be non-decreasing under 
local physical operations applied to the B system. Here, 
we show that this is indeed the case for H^ lin (A\B) and 
i^max(A|B). T ne mos t general physical operations are 
modeled by TP-CPMs and we denote by X A the identity 
TP-CPM on V(H A ). 

Theorem 18. Let e > 0, p AB G S<(Tt AB ) and £ : 
V(H B ) -» V(H D ) be a TP-CPM with t ad := (l A <g> 
£)(Pab), then 

H^(A\B) p < i^ n (A|D) T and 
fff nax (A|B) p < ^ax(A|D) r . 

Proof. For a sufficiently large Hilbert space H R , the TP- 
CPM £ can be decomposed into an isometry U : 7~ L B — > 
H D r followed by a partial trace over Tt R (see e.g. [l2|j). 
The invariance of the two quantities under local isome- 
tries was established in Lemmas 1 1 3 1 and 1 1 5 [ so it remains 
to show that the quantities are non-decreasing under par- 
tial trace 7 , i.e. the inequalities 

i^ lin (A|DR) r < -ff,ni n (A|D) T and 

^max(A|DR) T < flLx(A|D) T . 

We first consider the inequality for the smooth min- 
entropy. Let f ADR G B £ {t aub ) and cr DR G V(H DK ) 
be the pair that optimizes the expression in ^ for 
ff* ln (A|DR) T , then 

?ADR < 1 A <8> CT DR f AD < 1 A <g <X D 



7 This property is sometimes referred to as strong sub-additivity of 
the smooth min- and max-entropies. This is due to the fact that 
H(A\HC) < -ff(A|B) is equivalent to the strong sub-additivity 
of the von Neumann entropy. 
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and, due to Property vi), the pair f AD S B e (t ad ) and o~ u € 
ViTL u ) is a candidate for the optimization in if^ in (A|D) r . 
Thus, ^ lin (A|DR) T < i/f nin (A|D) T . 

For the smooth max-entropy, let r ADRE £ 5<(7i ADRE ) 
be a purification of t adr , then 

-^max( A l DR -)r = "^min ( A l E )r 

<-^ in (A|ER) r = ^ iax (A|D) T , 
which concludes the proof. □ 

The second pair of data-processing inequalities con- 
cerns projective (von Neumann) measurements of the 
system A. Such measurements can be described in terms 
of an orthonormal basis {|«) A }« of TL A and a TP-CPM M. 
from H A to W x — H A which maps p A to X^(*I/°aN) N)(*|x- 
We expect that the uncertainty about the system A as 
well as the entropies H^ in (AB|C) and i/„ lax (AB|C) will 
not decrease with such a measurement. 

Theorem 19. Let e > 0, p ABC € S<(H. ABC ) and M. : 
V(Tl A ) — > V(Ti x ) a TP-CPM describing a projective 
measurement with r XB c : — (M ®I bc )(Pabc). Then, 

ff* in (AB|C) p < ff* in (XB|C) T and 
^ ax (AB|C), <iJf nax (XB|C) T . 

Proof. Note that M. can be decomposed into an isometry 
U : TL A — > H x ® W x , H x = W x that maps |«) A to |i) x ® 
|i) x / followed by a partial trace over Ti.' x . We denote the 
intermediate state by r xx / BC and the projector onto the 
image of U by II XX '. Moreover, Note that M(t A ) = l x . 

We first prove the statement for the min-entropy. 
Let p ABC 6 B £ (p ABC ) and er c E V(Hc) such that 
i^ in (AB|C) p = £f min (AB|C) p = -logtrac. Then, 
Pabc < Iab ® o"o implies 

X b *y ctq . 

The state f XBC := (M <g> X B c) (Pabc) is in S £ (t XB c) due 
to Lemma [7J Hence, f XBC with <r c is a candidate for the 
optimization in i2^ ln (XB | C) T and, thus, iJ^ lin (XB|C) T > 
^ in (AB|C) p . 

To prove the statement for the max-entropy, we 
let f XBC € B £ (t xbo ) be such that H^(XB\C) r = 
i? max (XB|C)r. We use Corollary [5] to introduce its ex- 
tension f xx / B c € B e (t xx / bc ). Furthermore, we employ ([5]) 
to get 

fl^ ax (XB|C) r = max logF(f XBC , 1 XB ® o- c f 

cr B eS = (H B ) 

> max logF(f XX ' BC , n xx - (g) 1 B ® cr c ) 
= max logF(r xx / B c, 1 XX ' B ® cr c ) 2 

v B £S = (H B ) 
= #ma X ( XX ' B l C )r , 

where we used that the fidelity can only increase un- 
der partial trace and introduced the state t xx / bc •= 
(II XX / (g l B c)T XX 'Bc(n xx ' <g> l BO ). We have 



B £ (t xx > bc ) due to the definition of t XX ' B c and Lemma[7] 
We use this and Lemma [15l to write i? max (XX'B|C)f > 
iZ^ ax (XX'B|C) T = i^ lax (AB|C) p , from which the lemma 
follows. □ 

Note that, in conjunction with the fully quantum gen- 
eralization of the AEP (Theorem 1 in [6]), the inequalities 
in Theorem [TBI and [T51 imply the same inequalities for the 
von Neumann entropy. 

APPENDIX A: TECHNICAL RESULTS 

Here, we establish some useful properties of the min- 
and max-entropies. In particular, we give bounds on the 
min- and max-entropies in terms of the Hilbert space di- 
mensions, show their continuity as a function of the state 
and prove that the max-entropy is concave. Properties 
analogous to the ones we present here are also found for 
the von Neumann entropy (see e.g. El 13). 

1. Preliminaries 

Let us consider the functional $ : p AB i— > 2~ h ™™( a \ b )p t 
which we extend to arbitrary Hermitian operators, 
^(H AB ), on TL AB as follows: 

$ : £t(W AB ) ->R , p AB ^ hif troa. 

Pab<1a®ct b 

The functional has the following properties: 

i) Multiplication with scalar: Let A > 0, then 
${\Pa B ) = A$(p AB ) • 

ii) Monotonicity: p AB > r AB => <&(p AB ) > $(t ab ). 

iii) Sub-Additivity: <P{p AB + r AB ) < ${p AB ) + $(r AB ). 
Furthermore, equality holds if tr(p B r B ) = 0. 

iv) Bounds: Let d A = dim7i A and d m i n = 
min{rf A ,dim7Y B }, then ^-trp AB < $(p AB ) < 
^min tr{p AB } + . 

Proof. To get the upper bound, first consider a normal- 
ized pure state (f) AB . Clearly, cj) AB < II A <g n B < 1 A (g> II B , 
where Llf and LI B are the projectors onto the support of 
(j) A and cj) B , respectively. Furthermore trII B < d thanks 
to the Schmidt decomposition. Using the eigenvalue de- 
composition p AB = J2i Aj AB , we get 

*(pAB)<trf ^ U ij< d ^intT{p AB }+. (Al) 

On the other hand, we have tr(l A <g o~ B ) > trp AB for any 
candidate cr B , hence, 

*(Pab) > J-tr^B- (A2) 
a A 

□ 
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Properties i) and iii) imply convexity of i.e. 
$(Ap AB + (1 - A)r AB ) < A$(p AB ) + (1 - A)*(t ab ). 



2. Bounds on the Conditional Entropies 

In H it was shown that, for p AB G S = (H AB ) 1 we have 
-ff min (A|B)p < ff max (A|B) p . For sub-normalized states 
p AB = tr p AB • p AB , we thus have 



#mi„( A l B )p + logtr/3 AB < # max (A|B) p - logtrp A 



We now establish bounds on the min- and max- 
entropies: 



Lemma 20. Let p AB £ S<(H AB ), d A 
dram = min{d A , dim TL B } , £/ien 



dim7Y A and 



-logd min < i? min (A|B) p + logtrp AB < logd A 
-logd min < i? max (A|B) p - logtr/9 AB < logd A . 

Proof. The bounds on the min-entropy follow directly 
from (|A1[) and (|A2[) . The bounds on the max-entropy 
follow by duality g]) and (|A"3j) . □ 



3. Continuity of the Conditional Entropies 

The operational interpretation of the conditional min- 
entropy as a guessing probability (cf. 7]) already implies 
its continuity in the state. To see this, note that a dis- 
continuity in the guessing probability could be detected 
experimentally using a fixed number of trials (the num- 
ber depending only on the required precision) , hence giv- 
ing us the means to distinguish between arbitrarily close 
states for a cost (in terms of the number of trials) in- 
dependent of their distance. For sufficiently close states, 
this would contradict the upper bound on the distinguish- 
ing advantage (TTJ. Here, we make this statement more 
precise. 

Lemma 21. Let p AB ,r AB G S<{TL AB ) and 5 := 
D(P 



AB j ' AB } ) 



then 



|H min (A|B) p - J ff min (A|B)J < 



d.dr, 



In 2 • min{trp AB , trr AB } 
Proof. We use continuity of the functional <i> to obtain 

$(r AB ) = <P{p AB + (r AB - p AB ) ) < $(/0 AB ) + $(t ab - Pab) 

< $(/0 AB ) + d min tr{r AB - p AB }+ < $(p AB ) + ^min $ ■ 

Note that $ > for all states in S<(TC AB ). Taking the 
logarithm and using the bound ln(a + x) < In a + -, we 
find 

i ^/ \ i ^ / \ ^ ^min 3 ~ d A d m [ n 8 

log$(r AB ) - log$(p AB ) < : < 



ln2-$(p AB ) ln2-tr/9 AB 

The same argument also applies on exchange of p AB and 
t ab and we obtain the statement of the lemma by sub- 
stituting # min (A|B) p = -log$(p AB ). □ 



Remark 22. The above result is tight in the follow- 
ing sense: Consider a system with Hilbert spaces Tl A and 
W B = ri' A ®ri' B , where H' A — H A . Let ip AB be the normal- 
ized fully entangled state on H A ® Tt' A and p B G S< (H B ) 
be orthogonal to tp B . The choice p AB — ^ ® p B and 
Tab = Pab + 5i/j ab for some small S > leads to 

D{P ab, Tab) = 5, 



*(Pab) 



tr Pb 



and $(r AB ) = $(p AB ) + d n 



(A3) Taking the logarithm (for small 6) leads to 



log$(r AB ) - log$(p A 



ln2-$(p AB ) ln2-trp A 



Lemma [5T] implies that the conditional min-entropy is 
uniformly (Lipschitz) continuous on the set of normalized 
states and in any e-ball. Since D(p, r) < P(p, r) (cf. 
Lemma[6]), Lemma [21] also holds for S = P{p ABl T AB ). 

The continuity of the smooth min- and max-entropies 
then follows: Let p AB G B £ (p AB ) be such that 
•^min( A l B )p = ^min( A l B )p- We now construct a state 
f A B that is e-close to r AB and <5'-close to p AB , where 
5' := VS 2 + 2eS. 8 We get 

ff^ in (A|B) p - ff* in (A|B) T < i/ min (A|B) p - ff min (A|B) f , 

which vanishes continuously for 5 — > due to Lemma [2~T1 
The continuity of the smooth max-entropy follows by du- 
ality ((3]) . Using Lemma [7J we introduce purifications 
p ABC of Pab and r ABC of r AB such that P(p AB ,r AB ) = 
-P(Pabc,t abc ) > P(p AC ,T AC ). Then, 

|-ft r max( A l B )p-- ff raax( A l B )T| = | #min ( A l C )p-#min ( A l C )r | 

which can be bounded using Lemma [2"T1 with c? m i n = d A . 



4. Concavity of the Max-Entropy 

The max-entropy is a concave function of the state. 

Lemma 23. Let {pi}i be a probability distribution, 
{p AB }i be a set of states in S<(Tt AB ) Q/fld Tab ■ — 
J2iPiP l AB- Then, 

ff max (A|B) r > ]>> ff max (A|B) pi . 



8 The construction is as follows: Let c := (S + e) 2 , ip be a 
purification of pab © (1 — trpAB) and i) a be purification of 
tab © (1 - trr AB ) such that |{</>|tf)| 2 = F(p A b,t A b) 2 > 1 - c 
We choose tab := c _1 (e 2 p A B + 5' 2 t ab )- Now, P(tab,t A b) 2 < 
P{c- 1 {e 2 V :+6' 2 -d),'d) 2 = l-c- 1 (i9|e 2 ¥ j+<5' 2 i?|i?> < l- C - 1 (8' 2 + 
e 2 (l - c)) = e 2 . Similarly, P(t ab ,Pab) < 8'. 
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Proof. Let |</? 1 ) A bc purify p\ B such that the state 
|t)abcyz := J2i VPi |v*)abo ® K)y <8 |i)z — where {|i) Y }i 
and {|«)z}j are orthonormal bases of the auxiliary Hilbert 
spaces H Y and 7i z , respectively — has marginals r AB and 
t A cz = J2iPiP l Ac ® |*X*U- Using data-processing of the 
max-entropy (Theorem I18|). the properties of $ and the 
concavity of the logarithm, wc find 

ff max (A|B) r > ff max (A|BY) T = -# min (A|CZ) T 

= log$(r A(cz) ) = log Pi ®(pioi) 

i 

> ]>>log<i>(p AC ) = ff mBX (A|B)„, . 



□ 



Note also that the min-entropy is neither a concave nor 
a convex function of the state. 
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